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How do you find a needle in a haystack? 


Image is in the public domain. Painting date 1874. File source is http://commons.wikimedia.Org/wiki/File:Haystacks_Autumn_1873_Jean-Francois_Millet.jpg 
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Spatial subdivision: what is it? 

• A structured partitioning of geometry 
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Spatial subdivision: what is it for? 

• Optimization! 
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Spatial subdivision: what is it for? 

• Optimization! 

• Manage rendering overhead 

• Support a geometry paging system 

• Minimize unnecessary geometry interrogation 
and pair-wise object tests for physics and AI 

• Not all games need this! 

• (many do) 
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Classes of spatial subdivision 

• Grid-based 

• Tree-based 

• Others 

• Bounding Volume Hierarchy 

• Scene Graph 

• Portals 
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Grid-based Spatial Subdivision 
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Overview of uniform grids 

• A 2 x 1 grid 
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Overview of uniform grids 

• A 2 x 2 grid 
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Overview of uniform grids 

• A 4 x 3 grid 
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Overview of uniform grids 

• A 4 x 3 grid 
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Overview of uniform grids 

• The spatial and dimensional properties 
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Overview of uniform grids 

• Spatial index of a cell: (i, j) or (i, j, k) 
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Overview of uniform grids 


Logical address of a cell: memory location 
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Implementation: ideas 

• Conceptual data structures 

Grid2D 

{ 

Container<Cell> gridCells; 

} 

Cell 

{ 

Container<Ob ject> gameObjects; 

} 
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Implementation: array of cells 

• A naive UniformGrid data structure 

NaiveUniformGrid2D 

{ 

Array<Cell> gridCells ; 

} 

Cell 

{ 

Container<Ob ject> gameObjects; 

} 
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Implementation: array of cells 

• Retrieving the cell at a point in space 
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Implementation: array of cells 

• Retrieving the cell at a point in space 
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Implementation: array of cells 

• Retrieving the cell at a point in space 

const int X = 0, Y = 1; 

int getCelllndex (int d, Vector2 pt) { return (int) (floor ( (p [d] - origin [d] ) /cellSize [d] )); } 


int getCellAddress (Vector2 pt) 

{ 

int i = getCelllndex (X, pt) ; 
int j = getCelllndex (Y, pt) ; 
return (numX * j) + i; 
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gridCells array 


(i,j) = (2,0) 
cell Address = 2 


20 


X 



GAME DEVELOPERS CONFERENCE' 2014 


MARCH 17-21 y 2014 GDCONF.COM 


Grid-size selection strategies 


What size should we choose for the grid 
cells? 
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Grid-size selection strategies 


What size should we choose for the grid 
cells? 
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Grid-size selection strategies 


What size should we choose for the grid 
cells? 
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Grid-size selection strategies 

• Optimum size ~ max object size + s 
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Grid-size selection strategies 

• What if object size varies significantly? 
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Populating the grid 

• Inserting an object into the grid 
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Populating the grid 


Insert into every overlapped cell 


void addObject (Object obj) 

{ 

pt = obj .minAABBPoint () ; 
addrLL = getCellAddress (pt) 
addrLR = addrLL + 1; 
addrUL = addrLL + numX; 
addrUR = addrUL + 1; 
gridCells [addrLL] .add (obj) ; 
gridCells [addrLR] . add (obj ) ; 
gridCells [addrUL] .add (obj) ; 
gridCells [addrUR] . add (obj ) ; 
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Populating the grid 


• Inserting into one cell (others are implicit) 


void addObject (Object obj) 

{ 

pt = obj .minAABBPoint () ; 
addr = getCellAddress (pt) ; 
gridCells [addr] .add (obj) ; 

} 
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Pairwise testing: visit which cells? 


If insert objects into every overlapped cell 
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Pairwise testing: visit which cells? 


• If insert objects only into one key cell 
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Avoiding duplicate tests 

• Bitfield, time stamping... 
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Ray intersection/line of sight tests 

• Find all objects that intersect a ray 
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Ray intersection/line of sight tests 

• Find all objects that intersect a ray 
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Ray intersection 

• Walking along the ray 
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Ray intersection 

• Walking along the ray 
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Ray intersection 

• Walking along the ray 
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Ray intersection 

• Walking along the ray 
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Ray intersection 

• Initializing the walk 




(i,j) 


(i+l/j) 

V(t) =p 0 + td 

P^exit.i) ~ Vo t exit, i,d 
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p(texit,i) 

i = getCelUndex(X,p 0 .x) 

p(.t eX it,i)-x = getCellPos(X,i + 1) 

texit.i = (getCellPos(X,i + 1) - p Q .x)/d.x 

CELLPOS(x, i) 

CELLPOS(x, i+ljS. 

<5;t = cellSiz e.x/d.x 

float getCellPos (int 

d, int index) { return (( (float) index) * cellSize [d] ) + origin [d] ; } 
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Avoiding duplicate tests 


Time stamping easier than with pairwise 
tests 
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Avoiding duplicate tests 


• May find an intersection in a different cell 
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Avoiding duplicate tests 

• Batch ray tests as optimization strategy 
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Back to array of cells 

• Does anyone see a problem with this 
naive approach? 

• Most cells are likely empty 

• Doesn't scale well due in part to large 
memory requirements 

• For these reasons, this naive array of cells 
approach is often a bad choice in practice 


44 



GAME DEVELOPERS CONFERENCE' 2014 


MARCH 17-21 y 2014 GDCONF.COM 


Implementation: spatial hash 

• Consider the following grid 
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Implementation: spatial hash 

• A multiplicative hash based on cell indices 
assigns each cell to a bucket 
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Implementation: spatial hash 

• Each bucket contains a list of cells 
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Implementation: spatial hash 


• Spatial hash grid data 

Bucket 

{ 

Container<BucketRecord> records ; 

} 

BucketRecord 

{ 

IntVector2 celllndex; 

Cell cellContents ; 

} 


structures 

Spat±alHashGrid2D 

{ 

Array<Bucket> cellBuckets ; 

} 
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Implementation: spatial hash 

• Spatial hash grid 

int getCelllndex (int d, Vector2 pt) { return (int) (floor (p [d] /cellSize [d] )) ; } 
float getCellPos (int d, int index) { return ( (float) index) * cellSize [d] ; } 

int prime 1 = 0xABlD261; 
int prime2 = 0xl6447CD5; 

int bucketAddress = (primel * i + prime2 * j) % numBuckets; 
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Implementation: spatial hash 

• Spatial hash grid 

Cell getCell (Vector2 pt) 

{ 

int bucke tAddr e s s = ge tBucke tAddr e s s (pt) ; 

IntVec2 index = { ge tCell Index (X, pt ) , getCelllndex (X, pt) }; 
if ( ! cellBuckets [bucke tlndex] . contains (bucketAddress) ) 

{ 

cellBuckets [bucketlndex] . insert (new BucketRecord ( { 

cell Index = index, 
cellContents = new Cell})); 

} 

return record. recordAt (bucketAddress) ; 


} 


50 



GAME DEVELOPERS CONFERENCE' 2014 MARCH 17-21, 2014 

Art history moment 



GDCONF.COM 


51 



GAME DEVELOPERS CONFERENCE* 2014 


MARCH 17-21 y 2014 GDCONF.COM 


Tree-based Spatial Subdivision 
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Overview of hierarchical subdivision 


A recursive partitioning of space 
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Objects appear to the "left" or "right" of 
the partition boundary 
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Overview of hierarchical subdivision 



Notice that we can represent this as a 
binary tree 
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Implementation: 

Kd-tree 


• A Kd-tree is an axis 

Y 

;-aligned BSP tree 
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Implementation: Kd-tree 

Y 

y 


• Data structures for a Kd-tree 


KdTree { KdNode rootNode; } 




KdNode 

{ 

int nodeType ; ^ 

int splitAxis; A .. _ 

float splitPos; A ' X < SpIltPoS 

union 

{ 

KdNode *childNodes; 

Container<Object> gameObjects; 

} 

} splitAxis 

X 

B.x 

B 

> splitPos 

X 

= X 

= splitPos 
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Implementation: Kd-tree 


• Locating a node given a point 


splitAxis = x 

p.x > node[0].splitPos 


splitAxis = y 

p . y < node[2].splitPos 
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Implementation: Kd-tree 

• Locating a node given a point 

KdNode f indNode (Vector2 pt) 

{ 

currentNode = rootNode; 
while (currentNode . hasChildren) 

{ 

if (pt [currentNode . splitAxis] <= currentNode . splitPos) 
currentNode = currentNode . childNodes [0] ; 
else 

currentNode = currentNode . childNodes [1] ; 

} 

return currentNode ; 


} 
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Implementation: 

• Ray intersection 
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Implementation: 

• Ray intersection 
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Implementation: 

• Ray intersection 
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Kd-tree h j 
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Implementation: 

• Ray intersection 
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Kd-tree h j 
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Implementation: 

• Ray intersection 
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Implementation: Kd-tree 


• Constructing a cost-optimized tree 

• Cost(cell) = Cost(traverse) + Probability(left hit)*Cost(left hit) + 

Probability(right hit)*Cost( right hit) 

• Isolate complexity and seek large empty spaces 

• Deeply subdivided trees tend to be more efficient on modern hardware 

• Profile performance for your use case 
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Implementation: 

quadtree/octree 

• If desired, a quadtree/octree can be 
implemented via a Kd-tree 
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Problems with hierarchical subdivision 

• Not suitable for dynamic/moving objects 
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Memory cache considerations 

• Typically 3-4 classes of system memory 

• Ll cache 

• L2 cache 

• L3 cache 

• Main memory 

• Penalty to access to main memory w/cache miss 

• 50-200 clock cycles vs. 1-2 cycles for Ll cache hit 

• Desirable to minimize occurrence of cache miss 
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Memory cache considerations 

• Cache memory population 

• Cache lines on modern hardware are usually 32 or 64 
bytes 


Chi pset/ Processor 

LI Data Cache Line Size 

Intel i7 

64 bytes 

Intel Atom 

64 bytes 

AMD Athlon 64 

64 bytes 

AMD Jaguar (Xbox One/PS4) 

64 bytes 

ARM Cortex A8 

64 bytes 

ARM Cortex A9 

32 bytes 
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Cache considerations for grid 

• Linked lists are bad. Real bad. 

• Minimize structure size for cell bucket 

• Bucket record stores spatial index and pointer 
to cell. Cell data stored elsewhere 

• Closed hashing 

• Structure packing 

• Align buckets to cache-line boundaries 

•C++ 1 1 std: :aligned_storage 
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Cache considerations for Kd-tree 

• With care and compromise, we can put a lot of 
tree into a single LI cache line 

• Apply Christer Ericson's bit packing approach 

• Cell data stored separate from tree itself 

• Binary heap data structure 

• Align structure to 64-byte boundary 

• A 64-byte cache line can store a fully subdivided 4 level 
Kd-tree 

• With 4 bytes left over to store sub-tree pointers 
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Cache considerations for Kd-tree 


• Ericson's Compact KdNode 

Union CompactKdNode 

{ 

float splitPos_type; 
uint32 cellDataIndex_type ; 

} 

f 

splitPos 

31 0 

cellDatalndex 


Mantissa 
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Cache considerations for Kd-tree 

• Ericson's Compact KdNode 

Union CompactKdNode 

{ 

float splitPos_type; 
uint32 cellDataIndex_type ; 

} Mantissa 


spl i t Po s_type 

31 0 

cellDataIndex_type 

0 0 Interior, axis=x 1 0 Interior, axis=y 0 1 Interior, axis=z 1 1 Leaf 


Node Type 
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Cache considerations for Kd-tree 

• Ericson's Compact KdNode 

• 4 level Kd-tree = 15 nodes 

• 15 x 4 bytes = 60 bytes 

• 4 bytes left point to sub-trees 

splitPos_type J 

31 0 

cellDataIndex_type 
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